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@) Stereo matching method and disparity measuring method 

@ A method of stereo matching and determin- 
ing the disparity of stereo images with as small 
amount of computations as possible, and a 
method of measuring the disparity capable of 
absortring a matching error which may occur, 
two right and left images are obtained by two 
imaging devices at imaging phase (A)(S1, 32). 
The right and left images obtained at imaging 
phase (A) have ttie characteristics thereof ext- 
racted respectively at characteristic extraction 
phase (B)(S3. S4). The resulting two right and 
left characteri^lc images are matched at the 
sut)sequent stereo matching pha^ (CKS^. At 
stereo matching phase (C), the window on one 
of the characteristic images providing a refer- Qry 
ence is scanned according to a predetermined 
scannirtg riile. A window providing a unit of 
matching Is sequentially set, and matching with (n 
the other characteristic onage is performed for _ 
each window thus set Disparity detenninatton y \ 
phase (D) dh/ides ttie reference characteristic 
image Into blodcs of predetermined size, gener- 
ates a histogram using the disparity obtained by 
matching of the window contained in each 
blodc, and determines a disparity at the histog- 
ram peak as the disparity of the particular block 
(86). 
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BACKGROUND OF THE INVENTION 
Field of the Invention 



The present invention relates to a method of stereo matching and a method of measuring the disparitv of 
Stereo .mages or more in particular to such methods applicable to various monitor systeriSdudingTviL^^^ 
for detecting obstacles or intruders in a railway crossing. <nuiuaing aevices 



Description of the Related Art 



First, the principle of stereo image measurement will be described with reference to Fig 1 Fiq lisoiotted 
wrth x. y. 2 as the coordinates representing the real space, an^ 

« V ' w . representing the position on the image plane of the left camera, and the coortinates T 

Ind to tZr, the position on the image plane of the right camera. The x axis is paralleTSreT^s 

to the optical axis of the two cameras. The origin of the real space coordinate system is taken at the mid-ooin 
between the preje««n centers Of the right and leftcameras. The distance betw^n the pro^^^^ 

. sr(f:ri^^^^^^^^^^^^ 

Bn<laZnTpSr^.tTLl!" ""f '"""^ °" " ""'"^ °" '^e left Image plane 

ana a point Pr(Xr, Yr) on the nght image plane respectively. These points P, and Pp are oresent on th« ».m« 
scanning line. In stereo image measurement. P,. P« are determined on the ImageXes' andThrr^^sT^^ 
coordinate x. y. z) of the point p is determined according to the principte of trigonometrical survey ,n^^^^^^^^ 

axra. the and Yr take the same value. The relation among the coordinates X^. Yl. Xr. Yo on the imaae oianes 
and the coordinates x. y, z in the real space Is given as: ^ ^ 

^»f(>l±^ 2an^ ^^af_ 

where 

d = Xl - Xr (3) 

™z ^1:2:2.1': ' •■'^ --^^ - 

,K- ^ XL>X,<andYL = Yr (4) 

pla'r^^eSl*tJr«' °" '"^g* P'ane -"^tch Ing or corresponding to another point on the other image 
ol^^fon . ^'^""'"^ an epipolar line in the range of X, > Xr. As a result a 

in a small regun along a straight line where the matching points are likely to exist "SV "an image 

ProJ^slo Han^c^^rM ""^o * *^ ^"^""^ ^ ^ '^*od described in "Image 

^x mTn ^ir; T '^''''""^ *° '='9.2. AssuI that a lali reZgulaT^ 

Z C^lr ?K K? ^"""'^ P"^"'* « -"^t^hing point is to be determined and^t 

Sr thlT^ bngWness of the rectangular area is l,(i.j). Wlj) respectively. T?e mean and variant ofVrightei 

rsrsrsyrsnre^^^^^^^^ 



5D 



55 



... (5) 



This value is computed along a straight line where a matching point is likely to exist, and a point associated 
wrth the maximum value is assumed to be a matching point According to tWs meth<;d a maSng 
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be determined by pbcel, and once a matching point is determined, the disparity d can be determined immediately 
using equation (3) from the coordinate point of the matching point 

It Is seen from the foregoing example that determination of a matching point requires a great amount of 
computations. In other words, it is necessary to execute the computations according to the at>ove-mentioned 

5 equation over the whole area where a matching point is likely to be present with regard to all the pixels requiring 
determination of a matching point The computation speed can t>e improved by reducing the size of the small 
area for determination of the correlation at the expense of image distortion or a greater effect of noises, thus 
deteriorating the stability for detection of a matching point With the increase in size of the small area, by con- 
trast, not only a longer computation time is requa-ed but also the change of the correlation value becomes ex- 

10 tremely gentle for a deteriorated accuracy of matching point detection. The size of the small area is required 
to be set appropriately according to the properties of the images involved. Further, in this method, as obvious 
from equation (3), the result of matching operation is immediately reflected in the disparity. Once an erroneous 
matching operation occurs, therefore, the error directly affects the disparity to be measured. An error in match- 
ir^ operation thus constitutes a disparity error. 

IS Other examples of the method for determining matching points between right and left images are described 

in "Drive Assist System by means of 3-0 Image Recognition technique' by Saneyoshi et al.. Release of Lectures 
No.924, pp.169-172 (Oct 1992). issued by Society of Automotive Engineers of Japan, Inc., and 'Development 
of Length-Measuring Algorithm Using Stereo Image Processing" by Sakagami, et at. Release of Lectures 
No.924, pp.153-156 (Oct 1992). issued by Society of Automotive Engineers of Japan, Inc. These methods will 

20 not specifically be described herein. 

The conventional methods of matching stereo images and the conventional methods of measuring the dis- 
parity, of stereo Images have the problem of an enormous time required for processing the computattons and 
a very high hardware cost which make these methods Impracticable. 

25 SUMMARY OF THE INVENTION 

In view of the above-mentioned problems, an object of the present invention is to provide a method of 
matching stereo matching and determining the disparity of stereo images with as snnall an amount of compu- 
tations as possible. 

30 Another object of the inventton is to provide a method of disparity measurement which is capable of ab- 

sorbing errors which rrmy occur in stereo. 

In order to achieve the above-mentioned objects, according to the method of the present invention, edge 
components are extracted from the two images (stereo images) on the right and left sides and each edge com- 
ponent is decided into a ternary value such as "1", "0" or "-1" according to threshold values TH1, TH2. Thus, 

35 the right and left images having ternary values, that is, ternary images are matched. Further, the whole image 
is divided into blocks of, for example, N x M pixels in size, and the disparity is measured by block thereby to 
reduce the anrKMint of computations considerably. In addition, in determining the disparity by block, a histogram 
is generated based on the disparity obtained by matching windows contained in the t>locks, and a disparity at 
the histogram peak is used as the disparity of the blocks. In this way, the error whk:h may occur in the matching 

40 each window and the resulting disparity are prevented from affecting the final block-based disparity measure- 
ments, thereby improving the reliability of the disparity measurement 

As descrit>ed above, according to the method of stereo matching or measuring the disparity of stereo inv 
ages of the present inventkin, the computation load is remarkably reduced as compared with the conventional 
methods. Therefore, the disparity for the whole screen can be measured within a short time from the sequential 

45 input of stereo images. Further, the system can be configured with low cost In addition, the reliability of the 
final disparity measurement can be improved. As a consequence, it is possible to realize a practical apparatus 
for detecting obstacles or intruders in a railway crossing or other practical industrial monitors by continuously 
measuring the disparity and checking the disparity changes from the sequentially-input stereo images. 

so BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram for explaining the principle of stereo image measurement 

Fig. 2 is a diagram for explaining a conventional method of stereo matching and a conventional method 
of measuring the disparity. 

55 Fig. 3 is a flowchart for explaining the flow of operations from acquisition of stereo images to the meas- 

urement of the disparity by block according to an embodiment of the invention. 

Fig. 4 is a diagram showing an example image used in an emtK>diment of the invention. 

Fig. 5A Is a flowchart of operations for the characteristic extraction phase according to the inventton. 

3 
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Fig. 5B is a diagram showing a method of deciding the image signal into a ternary value 

acccSg to I^^vtnttof ^^"^ * ^"^^^ « 

to thefnv^niton.*"^^'*'" ""'^'^ ' "^teMng area search of windows constituting a unit of matching according 
^ ^ diagrams for explaining a method of evaluating the degree of coincidence between 

linages. 

ir^a'c!?o?dfngt?H^J:Z''"^ 

dfenTSw^nJ^^^ll^T ^ ^ °f Storing the first candidate disparity, the second candidate 

T^^ and the f ag for the windows constituting a unit of matching according to the invention. 
« ..n^f^' h1 J! are diagrams for explaining a method of determining the disparity of blodos constituting 
a unit for disparity determination according to the invention. «»n8iiiuung 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

m««^!?r™f J'T^r explaining the flow of operations fmm acquisition of stereo images to disparity 
a« ob^Z. L L ^T^'J ^" ^"''^'^""^"t °^ the invention. First, two right and left images (S1 S2) 
are obtained two imaging devices at Imaging phase (A). The right and leftimages Obtained atimL^^^ 
sa'Sr A : *° T'^''^''"' '''^^^ ^^'^ ^'^^ Characteristic; of the imaged are SSJS 

ilL^ttrt rhV,".^^?r* ""^^ "'^^ ^"'^ charecteristic Images are matched^^ 

n?«r. Jm H ""^"^f ""^^ performed for each window thus set. The disparity determination 
«Jd « h2 '''''^ characteristic images providing a reference into blocks of a predetermined sfee 

A dispanty at the histogram peak is determined as a disparity of the particular block (S6). The processes S 
formed at each phase will be described in more detail betow. processes per 

(A) Imaging phase 

andleftcan^eras are arranged in paralleUtwo cameras are arranged at rightandleftsldes in ho^^^ 

wrth the opt«al axes thereof parallel to each other). Fig. 1 shows an ideal parallel arrenge^t S Zfa^ 

Ir d.?^*^ • '* '-"PO't^"* to P"vide some flexibility to the method of ster«, mateh^ 

or dispanty measurement of stereo images to allow for some displacement niaccning 

in « ^'**'°"8»' the descriptton of embodiments given below refers to a monochromatic image of 768 x 480 

fined to such a case. The left and right images obtained at imaging phase (A) are assumed to be 

Left image: IL(x,y) 

Right image: IR(x.y} 
where 1 s x s 788, 1 s y s 480 and 
0 S iL(x.y) S 255. 0 £ IR(x.y) S 255 

l^nes o°f mi^iSge.' " '""^^ *«««0" <rf image and y an index along the 

(B) Characteristic extraction phase 

First, the input image is applied to a smoothing step (S7) where high-frequency noise components of the 
image are reduced threugh a smoothing filter. The smoothing filter may be a spaVlal me!^J!^Xe^^ 
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G(x:a) 



BXP(-^) 



(6) 



or a Gausian filter having the foflowlng characteristic: 

1 

This smoothing step (S7), tiowever. may be eliminated when the S/N ratio of the input innage is satisfactory. 

As the next step, the edge extraction step (S8) (differentiation) is effected for extracting vertical edges 
through an edge extraction filter. The edge extraction filter may be a Sobel filter (primary differentiation) hav- 
ing the coefficients: 
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or a Lapiadan filter (secondary differentiation) having the coefficients: 
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The inr)age subjected to the smoothing step (S7) and the edge extraction step (SB) has the DC components 
and high-frequency components (mainly, noise components) thereof removed. More specifically, the combin- 
ation of the snru>othing step and the edge extraction step is equivalent to a band-pass filter. The image, there- 
fore, may alternatively t>e decided into a ternary value after being applied through a band-pass filter having 
the following characteristic: 



Vertical edges are extracted due to the feet that the parallel arrangement of right and left stereo cameras gen- 
erates the disparity only in the horizontal direction. 

Further, the image subjected to the edge extraction step is decided into a ternary value by pixel (S9) in 
the following manner, for example, by a positive threshold value TH1 and a negative threshold value TH2. 

As illustrated in Fig.5B, 
-1 for pixels less than TH2 

0 for pixels not less than TH2 but less than TH1 

1 for pixels not less than TH1 

The ternary image (three-valued image) assumes -1 or 1 at an edge and 0 at a non-edge portion. In other 
words, a ternary innage is assumed to include 

Left ternary Image: FL(x,y) 

Right ternary image: FR(x,y) 

where 1 ^ x ^ 768, 1 ^ y ^ 480 

and -1 ^ FL(x,y) ^ 1, -1 ^ FR(x.y) ^ 1 
The ternary images are applied to the subsequent stereo matching phase (C) where the right and left ternary 
images are matched with each other. 
(C) Stereo matching phase 

Stereo matching phase (C) matches the right and left images with each other using right and left images 
three-valued at characteristic extraction phase (B). fn the stereo matching phase, one of the Images is used 
as a reference to search the other image for a matching area. The embodiment under consideration is con- 
cerned with the case where the left image is used as a reference. First, the left ternary image providing a ref- 
erence is divided into blocks of N x M pixels in size. According to this embodiment, both N and M assume 16 
so that the image is divided into 16x16 pixels in size. As a result, the left ternary image is split into 48 horizontal 
areas and 30 vertical areas for a total of 1440 blocks. A block identifier of BL(X,Y) will be used hereinafter. 
The left block Identifier, for example, is expressed as BL(X,Y), where 1 ^ X ^ 48 and 1 ^ Y ^ 30 

A specific example method of matching will be explained. According to the embodiment under consider- 
atton, matching is effected only for odd-numbered lines (the scanning lines intended for matching are specif- 
ically called object scanning lines), and the informatton on even-numbered lines are not utilized at all after ster- 
eo matching phase (C). 

Next, as shown in Figs.7A to 7C, one-dimenskmal windows having a size of 16 pixels in the horizontal di- 
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rection are moved while being overlapped each eight pixels on odd-numbered lines (object scanning lines) of 
the left ternary image. Consequently, the window scanning for each object scanning line sets 95 windows, 
and a matching candidate area is determined from the right tertiarized image for each window thus set 

The matching candidate area, as shown in Fig.8A, is determined up to second candidates for each window. 
5 The disparity or displacement for the area with the highest degree of coincidence Is assumed to be the first 
candidate disparity (disp1), and the disparity for the area having the next highest degree of coincidence to be 
the second candidate disparity (disp2). 

Also, a flag representing an edge distribution within each window is created for each window. The first 
and second candidate disparityes obtained by homologization for each window as described above are dis- 
10 parity candidates but not the final disparityes. The final disparityes are detennined using the first candidate 
disparity and the second candidate disparity for each of the divided blocks at the subsequent disparity deter- 
mination phase. 

Now. a method of evaluating the degree of coincidence and a method of creating a flag will be explained. 
A method of evaluating the degree of coincidence will be explained with reference to Fig. 8B. The degree 

IS of coincidence Is evaluated by making comparison between the 16 pixels in the one-dimensional horizontal 
window of 16 pixels in size set on the left ternary image providing a reference and the 16 horizontal pixels 
present in the range of the right ternary image where a matching area is likely to exist More specifically, eval- 
uation is effected for each of the 16 pbcels In the window according to the evaluation method shown in Fig. 8C. 
and the foltowing relation is determined from the result of evaluatton of the 1 6 pixels. 

^ Coincidence evaluation function E = (Number of "P") + (Number of "Z") s 16 (8) 

The larger the coincidence evaluation function E. the coincidence Is evaluated to be higher in degree. Also, 
the number of "P* in equation (8) represents the number of coincident pixels for the edges characteristic of 
matching. It is assumed that the larger the number of coincident pixels, the higher the reliability of matching 
result, and vice versa. In the case where the number of *P* obtained as the result of coincidence evaluation 

25 for the first candkiate disparity is smaller than a threshold value TH3, therefore, an erroneous matching can 
be reduced by Invalidating the particular candidate disparity. 

This method of coincidence evaluation, as compared with the conventional method of evaluation given in 
equation (5), has the amount of required computations remarkably reduced. 

(1) Matching by window 

30 In the method of equation (5), the disparity is measured for each pixel. More specifically, an area of 

n X m in size is set around a pixel constituting an object of disparity measurement, and an area most ana- 
logous (as evaluated according to equatton (5)) is determined from the other image. The coordinate point 
of this area is used to determine the disparity of the pixels intended for measurement 

According to the method of the present emt>odiment, on the other hand, a disparity candidate is de- 

35 termined for each window overlapped by eight pixels. 

(2) One-dimensional evaluation 

In the conventk)nal method according to equatk>n (5), the degree of coincidence for a two-dimensk>nal 
area of n x m in size is evaluated, while according to the method of the present embodiment concerns the 
comparison of a one-dimensional area (16 pixels in horizontal directk>n. for example). 
^ (3) Comparison of ternary values 

As compared with the conventional method of equation (5) requiring the addition, subtraction, multi- 
plication and divlston of 8 bits, the operatk)n in the method according to the present embodiment basically 
is a simple comparison of 2 bits. 

A method of creating a flag for a window providing a unit of matching will be explained with reference to 
45 Fig. 9. The disparity for an area, which is associated with the highest degree of coincidence as determined in 
the search for a matching area executed for each one-dimensional window of 16 pixels In size moved while 
being overlapped eight pixels on the left ternary image, constitutes the first candidate disparity (displ). The 
number of pixels determined as "P" among the eight pixels on the left half of the 16 pixels Is given as "est/, 
and the number of pixels determined as "P" among the eight pixels on the right half as "estr". In the process, 
so a flag is created in the following manner. 

Flag dispF = 0 when esti ^ est. 
Flag dIspF = 1 when est, < est. 
The flag thus created roughly represents an edge distribution in the window set for the left ternary image in- 
tended for matching search. 
ss When dispF = 0. more edges are contained in the left eight of the 16 pbcels in the window. 

When dispF = 1, more edges are contained in the right eight of the 16 pixels in the window. 
In another method of flag creation, the number of -1 and 1 pixels present in the eight left-half pixels of the 
16 pixels in the one-dimensional window is assumed to be edgel, and the number of -1 and 1 pixels among 



DOCIO: <EP 0686942A2.I_> 




EP 0 686 942 A2 



the eight right-half pixels to be edgr, with a flag being created as follows. 

When edgi ^ edg^ flag dispF = 0 

When edgi < edgr, flag dispF - 1 
The flag thus created is used for determining the disparity of blocks at the subsequent disparity determination 
5 phase. 

Now. the first candidate disparity (displ), the second candidate disparity (disp2) and the flag (dispF) de- 
termined for each window scanned while being overlapped eight pixels on odd-numbered lines of the left tern- 
ary image are stored in a storage memory as shown in Fig. 10, for example. In Fig. 10, however, the storage 
area is plotted in a manner to facilitate the understanding of the homology with the image, although the blank 

10 portion is not required actually. 
(D) Disparity determination phase 

Disparity determination phase (D) determines the disparity for each of the blocks (1440 blocks) using the 
first candidate disparity (displ). the second candidate disparity (disp2) and the flag (dispF) determined for each 
window at stereo matching phase (C). 

IS Amethod of determining the disparity of a block will be explained. Figs. IIAand 11B are diagrams for ex- 

plaining a method of determining the disparity of block BL(X,Y). Determination of the disparity of block BL(X.Y) 
uses the first candidate disparity (displ), the second candidate disparity (disp2) and the flag (dispF) stored in 
the dashed line of Fig. 11A (24 sets in total in this embodiment). The first candidate disparity (displ) and the 
second candidate disparity (disp2) present in the dashed line are determined by matching a window containing 

20 at least eight pixels in block BL(X,Y). 

Nevertheless, ail the first candidate disparityes (displ) and the second candidate disparityes (disp2) in 
the dashed line are not used, but they are selectK^y used on the basis of the flag (dispF) Informatton. 

A specific method will be explained with reference to Figs. 11 A and 11 B. By way of explanation, the first 
candidate disparity, the second candidate disparity and the flag determined by matching a window containing 

25 16 pixels in block BL(X,Y) are designated as displ PC.Y), dlsp2(X,Y) and dispF(X.Y) respectively. According 
to this embodiment, only odd-numbered lines constitute object scanning lines, and therefore eight sets of 
disp1(X,Y), disp2(X,Y) and dispF(X,Y) are present in the block. Also, the first candkjate disparity, the second 
candidate disparity and the flag determined by the matching of a window containing eight left pixels in block 
BL(X,Y) are designated as displ (X-0.5,Y), disp2(X-0.5.Y) and dispF(X-0.5,Y) respectively. Eight sets of them 

30 are similarly present Further, the first candidate disparity, the second candidate disparity and the flag deter- 
mined by matching a window containing the right eight pixels in block BL(X,Y) are designated as 
disp1(X-i-0.5,Y), dlsp2(X-K}.5,Y) and dlspF(X-*>0.5,Y) respectively, of which eight sets are present as in the pre- 
ceding case. 

A histogram is generated according to the following procedure from the first candkiate disparity, the second 
35 candidate disparity and the flag defined in the dashed line. 

(1) First, displ (X,Y) and disp2(X,Y) are unconditk>nally Incorporated in the histogram. 

Where displ (X.Y) and disp2(X,Y) are disparity Information obtained by matching a window containing 
the 16 pixels present within block BL(X,Y). 

(2) When dispF(X.Y) = 0. displ (X-0.5,Y) and disp2(X-0.5,Y} are Incorporated into the histogram. 

40 The expression dispF(XY) - o indicates that there are many edges in the left eight pixels of block 

BL(X.Y). In view of the fact that the degree of edge coincidence is crucial in the evaluation of the degree 
of coincidence, the disparity information obtained by matching a window containing the left eight pixels of 
block BL(X,Y) and the right eight pixels of block BL(X-1.Y) is used for determining the disparity for the 
blocks. 

45 (3) When dispF(X.Y) = 1. displ (X+0.5.Y) and dlsp2(X-i-0.5.Y) are incorporated into the histogram. 

The relation dlspF(X,Y) = 1 indicates that there are many edges in the right eight pixels of block 
BL(X, Y). The disparity information obtained by matching a window containing the right eight pixels of block 
BL(XY) and the left eight pixels of block BUX-i-LY) is used for determining the disparity between the 
blocks. 

so (4) The process specified in (1) to (3) afc>ove is performed for the eight object scanning lines within the 

dashed line. 

A histogram of the disparity is generated according to the above-described procedure, and a disparity a 
peak of the histogram thus generated is used as the disparity of block BL(X,Y). 

By using the disparity at the peak of the histogram as the disparity of block BL(X,Y). an error which may 
55 occur in the matching operation executed for each window (or an erroneous candidate disparity which may be 
measured) can t>e absorbed appropriately. 

The foregoing is an explanation of the processes from acquisition of stereo images to disparity measure- 
ment according to an embodinnent of the invention. This emt>odinr)ent is concerned with the case using only 
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odd-numbered lines as object scanning lines. Asimilar result is expected wfien even-numbered lines are used. 
In ttie case where all the lines are used as object scanning lines, the reliability of disparity measurement is 
expected to improve although the amount of processing alnrK>st doubles that of the present embodiment Fur- 
ther, the present invention is not of course confined to the window size N of 16 pixels in horizontal direction ' 

5 and the t>tock size N x M of 16 x 16 pixels, as employed in the present embodiment. 

It will thus be understood from the foregoing description that according to the present invention, there is 
provided a n^thod of stereo matching and a method of disparity measurement of stereo images, in which the 
amount of computations is remarkably reduced as compared with the conventional method, and therefore the 
disparity of the whole screen can be measured within a short length of time from the sequentially-input stereo 

10 images. In addition, an apparatus can be constructed with low cost. Further, the reliability of the final disparity 
measurement is improved. As a result, an industrial monitoring system including an apparatus for detecting 
obstacles or intruders in a railway crossing can be realized commercially in which the disparity is measured 
and the disparity change monitored continuously from sequentially-input stereo images. 



IS 



Claims 



1. A method of matching right and left stereo images InDaged by two imaging devices arranged horizontally 
at predetermined spaced relationship with each other, comprising the steps of: 

20 extracting edges from the right and left stereo images by using selected one of primary differen- 

tiation and secondary differentiation (S3,S4); 

deciding a level of each extracted edge Into a ternary value by using a first threshold value (TH1) 
and a second threshold valve (TH2) (S3,S4); and 

matching the right and left stereo images on the k>asis of the ternary values thereof obtained 
25 through said deckling step (S5). 

2. A method of matching right and left stereo inrages imaged by two imaging devices arranged horizontally 
at predetermined spaced relationship with each other, comprising the steps of: 

reducing noise components of the right and left stereo images through a low-pass filter (87), 
3o extracting edges from the right and left stereo images by using selected one of primary differen- 

tiation and secondary differentiation (SB); 

deciding a level of each extracted edge into a ternary value by using a first threshold value (TH1) 
and a second threshold value (TH2) (S9); and 

matching the right and left stereo images on the basis of the ternary values thereof obtained by 
3S said deciding step (S5). 

3. A method of matching right and left stereo images Innaged by two Imaging devices arranged horizontally 
at predetermined spaced relationship with each other, comprising the steps of: 

reducing out-of-band high-frequency noise components of the right and left stereo images while 
40 extracting edges from the right and left stereo images having in-band frequency components through a 

band-pass filter (S7,S8); 

deciding a level of each extracted edge into a ternary value by using a first threshold value (TH1 ) 
and a second threshold value (TH2) (S9); and 

matching the right and left stereo images using on the basis of the ternary values thereof obtained 
45 through said tertiarizing step (S5). 

4. A method according to Claim 1 , 2 or 3, further comprising the steps of: 

setting a one-dimensional window of N pixels in size along horizontal direction on one of the right 
and left stereo images having the ternary values; and 
so searching, in the other of the right and left stereo images, an area analogous to the ternary pattern 

of N pixels in said window. 

5. A method according to Claim 4. wherein: 

said deciding step includes quantizing the pixels not less than the first threshold value (TH1) as p. 
55 the pixels not less than the second threshold value (TH2) but less than the f irat threshold value (TH 1 ) as 

z and the pixels less than the second threshold value (TH2) as m; 

said method further comprising the step of evaluating the degree of coinddence between the pixels 
in each one-dimensional window by using the following coincidence evaluation formula E for the ternary 
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pattern of N pixels in the window, 

E - Number of pixels P + Number of pixels Z 
where P is designated as the right and left pixels all of which are selected one of pixels p and pixels m, 
and Z is designated as the right and left pixels all of which are pixels z. 

A method according to Claim S.further comprising the step of determining that the matching for the window 
is valid only when the number of pixels P in the evaluation formula E is not less than a third threshold 
value (THS). 

A method according to Claim 1 , 2 or 3, further comprising the steps of: 

setting a one-dlmensional window of N pixels in size In horizontal directbn on one of the right and 
left stereo images having the ternary values; 

searching, in the other of the right and left stereo images, an area of the highest degree of coinci- 
dence with the ternary pattern of N pbcels in said window and an area olS the next highest degree of co- 
incidence with said ternary pattern; 

designating the disparity for the area of the highest degree of coincidence as the first candidate 
disparity and the area of the next highest degree of coincidence as the second candidate disparity; and 

determining the disparity of the right and left stereo images using said first candidate disparity and 
said second candidate disparity. 

A method according to Claim 4, 5 or 7, further comprising the steps of: 

setting a one-dimensional window of N pixels in size in horizontal direction by overlapping one of 
the right and left stereo Images having the ternary values by units of N/2 pixels while sequentially scanning 
the whole screen on scanning lines; and 

matching the right and left stereo images for each window thus set. 

A method according to Claim 4, 5 or 7, further comprising the steps oh 

setting a one-dimensional window of N pixels in size in horizontal direction by overlapping one of 
the right and left stereo images having the ternary values by units of N/2 pixels while sequentially scanning 
the whole screen on selected one of odd-numbered lines and evennumbered lines; and 

matching the right and left stereo images for each window thus set 

A method of measuring the stereo image disparity, comprising the steps of: 

dividing a whole screen of each of the rightan dieft s tereo images into blocks of N x M pixels In 

size; 

generating a histogram using selected one of said first candidate disparity and said second can- 
didate disparity in Claim 7 determined by matching a one-dimensional window in Claim 8 or 9 contained 
in each block, and; 

determining a disparity at a peak of the histogram as the disparity of the particular block. 

In a method of stereo matching for each one-dimenstonal window of N pixels in size in horizontal direction 
according to Claim 4, 8 or 9, a method of measuring the stereo image disparity comprising the step of 
generating a histogram of Claim 10 by use of the number esti of pixels determined as P in the left-half 
N/2 pixels among the N pixels and the number estr of pixels determined as P in the right-half N/2 pixels 
of said window, from the result of coincidence evaluation with the disparity (first candidate disparity) for 
an area determined to be highest in the degree of coincidence based on the coincidence evaluation for- 
mula E according to Claim 5. 

In a method of stereo matching for each one-dimensional window of N pixels in size in horizontel direction 
according to Qaim 4. 8 or 9, a method of measuring the stereo image disparity comprising the step of 
generating a histogram of Claim 10 by use of the number edgl of pixels p and m present in the left-half 
N/2 pixels and the number edgr of pixels p and m present in the right-half N/2 pixels among the N pixels 
conteined in the one-dimensk>nal window set on one of the two right and left images decided into p. z, m 
according to Qaim 5, said one of the ternary images constituting a reference image. 
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